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Abstract 



I We obtain necessary and sufficient conditions for tlie existence of strictly sta- 

tionary solutions of multivariate ARMA equations with independent and identically 



distributed noise. For general ARMA(p, q) equations these conditions are expressed 
in terms of the characteristic polynomials of the defining equations and moments of 
the driving noise sequence, while for p = 1 an additional characterization is obtained 
in terms of the Jordan canonical decomposition of the autoregressive matrix, the 
, moving average coefficient matrices and the noise sequence. No a priori assumptions 

, are made on either the driving noise sequence or the coefficient matrices. 

cn 
in . 

O ■ 1 Introduction 

Let m,d E N = {1,2 ...,}, p,q E No = N U {0}, {Zt)tez be a cZ-variate noise sequence 
•a . of random vectors defined on some probability space (n, P) and C™- 
■ and Go, . . . , Og € C™^ be deterministic complex- valued matrices. Then any m-variate 
stochastic process (Yt)tez defined on the same probability space {fl, J-", P) which satisfies 
almost surely 

Yt - - ... - %Ft_p = QoZt + ... + OgZt-,, t E Z, (1.1) 

is called a solution of the ARMA(p, q) equation (II. ip (autoregressive moving average 
equation of autoregressive order p and moving average order q). Such a solution is often 
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called a VARMA (vector ARMA) process to distinguish it from the scalar case, but we 
shall simply use the term ARMA throughout. Denoting the identity matrix in C™^™ by 
Idm, the characteristic polynomials P{z) and Q{z) of the ARMA(p, q) equation (11 .ip are 
defined as 

p q 
P{z) := Id„ - ^kZ^ and Q{z) := J] QkZ^ for zeC (1.2) 

k=X k=0 

With the aid of the backwards shift operator B, equation (II. ip can be written more 
compactly in the form 

P{B)Yt = Q{B)Zt, t e Z. 

There is evidence to show that, although VARMA(p, q) models with g > are more 
difficult to estimate than VARMA(]9, 0) (vector autoregressive) models, significant im- 
provement in forecasting performance can be achieved by allowing the moving average 
order q to be greater than zero. See, for example, Athanosopoulos and Vahid [1], where 
such improvement is demonstrated for a variety of macroeconomic time series. 

Much attention has been paid to weak ARMA processes, i.e. weakly stationary so- 
lutions to (ll.ip if {Zt)tez is a weak white noise sequence. Recall that a C-valued pro- 
cess {Xt)t£z is weakly stationary if each Xt has finite second moment, and if EX^ and 
Gov {Xt, Xt^fi) do not depend on t G Z for each /i G Z. If additionally every component of 
Xt is uncorrelated with every component of Xf for t ^ t', then {Xt)tez is called weak white 
noise. In the case when m = d = 1 and Zt is weak white noise having non-zero variance, it 
can easily be shown using spectral analysis, see e.g. Brockwell and Davis [3], Problem 4.28, 
that a weak ARMA process exists if and only if the rational function z i— )■ Q{z)/P{z) has 
only removable singularities on the unit circle in C For higher dimensions, it is well 
known that a sufficient condition for weak ARMA processes to exist is that the polyno- 
mial z I— )• det P(2;) has no zeroes on the unit circle (this follows as in Theorem 11.3.1 of 
Brockwell and Davis [3J, by developing P~^{z) = (det P{z))~^Ad}{P{z)), where Adj(P(z)) 
denotes the adjugate matrix of P{z), into a Laurent series which is convergent in a neigh- 
borhood of the unit circle). However, to the best of our knowledge necessary and sufficient 
conditions have not been given in the literature so far. We shall obtain such a condition 
in terms of the matrix rational function z i— ?■ P^^{z)Q{z) in Theorem 12.31 the proof being 
an easy extension of the corresponding one- dimensional result. 

Weak ARMA processes, by definition, are restricted to have finite second moments. 
However financial time series often exhibit apparent heavy-tailed behaviour with asym- 
metric marginal distributions, so that second-order properties are inadequate to account 
for the data. To deal with such phenomena we focus in this paper on strict ARMA pro- 
cesses, by which we mean strictly stationary solutions of ( II. ip when {Zt)tez is supposed 
to be an independent and identically distributed (i.i.d.) sequence of random vectors, not 
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necessarily with finite variance. A sequence {Xt)tei, is strictly stationary if all its finite 
dimensional distributions are shift invariant. Much less is known about strict ARMA pro- 
cesses, and it was shown only recently for m = d = 1 in Brockwell and Lindner that for 
i.i.d. non-deterministic noise {Zt)tez, a strictly stationary solution to (11. ip exists if and 
only if Q{z) / P{z) has only removable singularities on the unit circle and Zq has finite log 
moment, or if Q{z)/P{z) is a polynomial. For higher dimensions, while it is known that 
finite log moment of Zq together with detP(z) 7^ for \z\ = 1 is sufficient for a strictly 
stationary solution to exist, by the same arguments used for weakly stationary solutions, 
necessary and sufficient conditions have not been available so far, and we shall obtain a 
complete solution to this question in Theorem \2.2\ thus generalizing the results of [1] to 
higher dimensions. A related question was considered by Bougerol and Picard [2] who, 
using their powerful results on random recurrence equations, showed in Theorem 4.1 of 
[2] that if Elog"*' 11^0 II < 00 and the characteristic polynomials are left-coprime, meaning 
that the only common left-divisors of P{z) and Q{z) are unimodular (see Section |6] for the 
precise definitions), then a non-anticipative strictly stationary solution to (II. ip exists if 
and only if det P{z) 7^ for |2;| < 1. Observe that for the characterization of the existence 
of strict (not necessarily non-anticipative) ARMA processes obtained in the present paper, 
we shall not make any a priori assumptions on log moments of the noise sequence or on 
left-coprimeness of the characteristic polynomials, but rather obtain related conditions as 
parts of our characterization. As an application of our main results, we shall then obtain 
a slight extension of Theorem 4.1 of Bougerol and Picard [2] in Theorem 16.81 by char- 
acterizing all non-anticipative strictly stationary solutions to (II. ip without any moment 
assumptions, however still assuming left-coprimeness of the characteristic polynomials. 

The paper is organized as follows. In Section [2] we state the main results of the paper. 
Theorem 12.11 gives necessary and sufficient conditions for the multivariate ARMA(1, q) 
model 



where {Zt)t& is an i.i.d. sequence, to have a strictly stationary solution. Elementary 
considerations will show that the question of strictly stationary solutions may be reduced 
to the corresponding question when \E'i is assumed to be in Jordan block form, and 
Theorem 12.11 gives a characterization of the existence of strictly stationary ARMA(l,g) 
processes in terms of the Jordan canonical decomposition of and properties of Zq and 
the coefficients 6fc. An explicit solution of (II. 3p . assuming its existence, is also derived 
and the question of uniqueness of this solution is addressed. 

Strict ARMA(p, q) processes are addressed in Theorem 12.21 Since every m-variate 
ARMA(p, q) process can be expressed in terms of a corresponding mp-variate ARMA(1, q) 
process, questions of existence and uniqueness can, in principle, be resolved by Theo- 





k=0 
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rem l2.1[ However, since the Jordan canonical form of the corresponding mp x mp-matrix 

in the corresponding higher- dimensional ARMA(l,g) representation is in general dif- 
ficult to handle, another more compact characterization is derived in Theorem 12. 2[ This 
characterization is given in terms of properties of the matrix rational function P^^{z)Q{z) 
and finite log moments of certain linear combinations of the components of Zq, extending 
the corresponding condition obtained in [Ij for m = d = 1 in a natural way. Although in 
the statement of Theorem 12.21 no transformation to Jordan canonical forms is needed, its 
proof makes fundamental use of Theorem 12. 1[ 

Theorem 12.31 deals with the corresponding question for weak ARMA(p, q) processes. 
The proofs of Theorems 12. [2731 and 12.21 are given in Sections [3l H] and O respectively. The 
proof of Theorem 12.21 makes crucial use of Theorems 12.11 and 12. 3[ 

The main results are further discussed in Section [6] and, as an application, the afore- 
mentioned characterization of non-anticipative strictly stationary solutions is obtained in 
Theorem 16. 8[ generalizing slightly the result of Bougerol and Picard [2]. 

Throughout the paper, vectors will be understood as column vectors and Cj will denote 
the i^^ unit vector in C™. The zero matrix in C"*^*" is denoted by Om.r or simply 0, 
the zero vector in C by 0,. or simply 0. The transpose of a matrix A is denoted by 

, and its complex conjugate transpose matrix hj A* = A . By || ■ || we denote an 
unspecific, but fixed vector norm on for s G N, as well as the corresponding matrix 
norm \\A\\ = sup^g^s n^n^^ We write log'''(x) := logmax{l,x} for x G M, and denote 

by P — lim limits in probability. 

2 Main results 

Theorems 12.11 and 12 .21 give necessary and sufficient conditions for the ARMA(1, q) equation 
(11. 3p and the ARMA(p, g) equation (II. ip . respectively, to have a strictly stationary solu- 
tion. In Theorem 12. H these conditions are expressed in terms of the i.i.d. noise sequence 
{Zt)tez, the coefficient matrices Go, . . . ,Qq and the Jordan canonical decomposition of "^i, 
while in Theorem 12.21 they are given in terms of the noise sequence and the characteristic 
polynomials P{z) and Q{z) as defined in (11. 2p . 

As background for Theorem 12.11 suppose that \E'i G C"^^™ and choose a (necessarily 
non-singular) matrix S G C"^™" such that S'^'^iS is in Jordan canonical form. Suppose 
also that S'^'^iS has H E N Jordan blocks, $i, . . . , the h^^ block beginning in row 
r/i, where ri := 1 < r2 < ■ ■ ■ < rn < fn + 1 =: th+i- A Jordan block with associated 
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eigenvalue A will always be understood to be of the form 

A o\ 

1 A 



(2.1) 



\0 1 Xj 

i.e. the entries 1 are below the main diagonal. 

Observe that (11. 3p has a strictly stationary solution {Yt)tez if and only if the corre- 
sponding equation for Xt := S^^Yt namely 

q 

Xt - S~'^iSXt-i = J2 S''<djZt-j, t e Z, (2.2) 

j=0 

has a strictly stationary solution. This will be the case only if the equation for the h*^ 
block, 

Xf ) := hXt, t G Z, (2.3) 
where is the (r/^+i — r^) x m matrix with {i,j) components, 

h{i,j)=< (2.4) 
I 0, otherwise, 

has a strictly stationary solution for each h = 1, . . . ,H. But these equations are simply 

Q 

xf)-$,.xS = 5^45-ie,Z„.„ tGZ, h = l,...,H, (2.5) 

j=0 

where is the h^^ Jordan block of S^^'^iS. 

Conversely if (12. 5 p has a strictly stationary solution X'^'^^ for each h G {1, . . . , H}, 
then we shall see from the proof of Theorem 12.11 that there exist (possibly different if 
\Xh\ = 1) strictly stationary solutions X^^^ of (12.51) for each h E {I, . . . , H}, such that 

r,:=5(x«^...,xi^)Y, tez, (2.6) 

is a strictly stationary solution of (II. 3p . 

Existence and uniqueness of a strictly stationary solution of (II. 3p is therefore equivalent 
to the existence and uniqueness of a strictly stationary solution of the equations (12. 5 p for 
each h G {1, . . . , H}. The necessary and sufficient condition for each one will depend 
on the value of the eigenvalue Xh associated with $/j and in particular on whether (a) 
\Xh\ G (0, 1), (b) \Xh\ > 1, (c) \Xh\ = 1 and Xh 7^ 1, (d) Xh = I and (e) Xh = 0. These cases 
will be addressed separately in the proof of Theorem 12. H which is given in Section [31 The 
aforementioned characterization in terms of the Jordan decomposition of now reads 
as follows. 
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Theorem 2.1. [Strict ARMA(l,g) processes] 

Let m,d & N, q E Nq, and let {Zt)tez be an i.i.d. sequence of 'C'^ -valued random vectors. 
Let ^1 G C™"*" and Go, . . . , 6, G C^""^ he complex-valued matrices. Let S e C^"""^ he 
an invertihle matrix such that S~^'^iS is in Jordan hlock form as ahove, with H Jordan 
hlocks h E {I, . . . , H}, and associated eigenvalues Xh, h E {1, . . . , H}. Let ri, . . . , rn+i 
he given as ahove and Ih as defined hy (12 ■4p . Then the ARMA{l,q) equation (11 .Sp has a 
strictly stationary solution Y if and only if the following statements (i) - (Hi) hold: 



(i) For every G {1, . . . , H} such that \Xh\ ^ 0, 1, 



Elog^ 



.fc=0 



< oo. 



(2.7) 



(ii) For every h G {l,...,iJ} such that = 1, hut Xh ^ 1, there exists a constant 
ah G C^+i-rh such that 



Y,'^r''IhS-'Qk]Zo = ah a.s. 



(2.8) 



vfc=0 



(Hi) For every h E {1, . . . , H} such that Xh = I, there exists a constant ah = (a/i,i, • • • , 
ah,rh+i-rhV ^ C^h+i-vh gy^^-ii^ fi^g^f Q,^ _^ = Q Q,^^ f|2.8l) holds. 

If these conditions are satisfied, then a strictly stationary solution to (11.31) is given hy 
(EH) with 



(h) ._ 



fc=(l-j)VO 



J' 



where fh G C'^+i"'"'' is a solution to 

{Idh - ^h)fh = ah, 



\K\ e (0,1) 
\Xh\ > 1 
Xh = 0, 

\K\ = i, 



(2.9) 



(2.10) 



which exists for Xh = 1 hy (Hi) and, for |A| = 1, A 7^ 1, hy the invertihility of (Id/,, — $/i). 
The series in (12.91) converge a.s. ahsolutely. 

If the necessary and sufficient conditions stated ahove are satisfied, then, provided the 
underlying prohahility space is rich enough to support a random variahle which is uniformly 
distrihuted on [0, 1) and independent of {Zt)t^i, the solution given hy (12. 6p and (12. 9p is the 
unique strictly stationary solution of (11. 3p if and only if \Xh\ 7^ 1 for all h E {1, . . . , H}. 
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Special cases of Theorem 12.11 will be treated in Corollaries 16. H 16.31 and Remark 16.21 
It is well known that every ARMA(p, q) process can be embedded into a higher dimen- 
sional ARMA(1, q) process as specified in Proposition 15 . 1 l of Section[5l Hence, in principle, 
the questions of existence and uniqueness of strictly stationary ARMA(p, q) processes can 
be reduced to Theorem 12. 1[ However, it is generally difficult to obtain the Jordan canon- 
ical decomposition of the (mp x mp)- dimensional matrix $ defined in Proposition 15. H 
which is needed to apply Theorem 12.11 Hence, a more natural approach is to express the 
conditions in terms of the characteristic polynomials P{z) and Q{z) of the ARMA(p, g) 
equation (11.11) . Observe that z det P(2;) is a polynomial in z G C, not identical to the 
zero polynomial. Hence P{z) is invertible except for a finite number of z. Also, denoting 
the adjugate matrix of P{z) by Adj(P(z)), it follows from Cramer's inversion rule that 
the inverse P~^{z) of P{z) may be written as 



which is a C'^^^'-valued rational function, i.e. all its entries are rational functions. For a 



some matrix polynomial Q{z), the singularities of M{z) are the zeroes of detP(z), and 
such a singularity, zq say, is removable if all entries of M{z) have removable singularities 
at zq. Further observe that if M{z) has only removable singularities on the unit circle 
in C, then M{z) can be expanded in a Laurent series M{z) = Yl'jL-oo ■^j^'' ^ convergent 
in a neighborhood of the unit circle. The characterization for the existence of strictly 
stationary ARMA(p, q) processes now reads as follows. 

Theorem 2.2. [Strict ARMA(p, q) processes] 

Let m,d,p & N, q ^ No, and let {Zt)tei he an i.i.d. sequence of €1.'^ -valued random vectors. 
Let . . . , \E'p G C™^™' and 6o, . . . , 6g G C™^'' he complex-valued matrices, and define 
the characteristic polynomials as in (11.21) . Define the linear suhspace 

K := {a E : the distrihution of a* Zq is degenerate to a Dirac measure} 

ofC'-, denote hy K-^ its orthogonal complement in C^, and let s := dimi^'-'- the vector 
space dimension of K-^. Let U G C'^^'^ be unitary such that U = x {Od-s} o-nd 
U K = {Og} X C^"^, and define the C'^^'^-valued rational function M{z) hy 



Then there is a constant m G * and a -valued i.i.d. sequence {wt)tez such that 



p-\z) = (detP(;z))~iAdj(P(z)) 



general matrix-valued rational function z i— )■ M{z) of the form M{z) = P 



{z)Q{z) with 




(2.11) 




(2.12) 
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and the distribution of b*WQ is not degenerate to a Dirac measure for any 6 G C \ {0}. 
Further, a strictly stationary solution to the ARMA{p, q) equation (II .ip exists if and only 
if the following statements (i) — (Hi) hold: 

(i) All singularities on the unit circle of the meromorphic function M{z) are removable. 

(a) If M{z) = Yl'jL-oo^j^'^ denotes the Laurent expansion of M in a neighbourhood of 
the unit circle, then 

Elog+ ||M,f/Zo|| < oo W J e {mp + q-p + 1,. . . ,mp + q}U{-p,. . . ,-1}. (2.13) 
(Hi) There exist w G C and g G C™ such that g is a solution to the linear equation 

P{l)g = Qm*iv^,nT- (2.14) 
Further, if (i) above holds, then condition (ii) can be replaced by 

(ii') If M{z) = Yl'jL-oo^j^'^ denotes the Laurent expansion of M in a neighbourhood of 
the unit circle, then YlJL-oo ^j^^t-j converges almost surely absolutely for every 
t G Z, 

and condition (Hi) can be replaced by 

(Hi') For all f G there exists a solution g = g{y) to the linear equation (I2.14p . 

If the conditions (i)-(iii) given above are satisfied, then a strictly stationary solution Y 
of the ARMA{p, q) equation (ll.ip is given by 

oo 

Yt = g+ M.iUZt-, - {v^.u^f), t G Z, (2.15) 

j=-oo 

the series converging almost surely absolutely. Further, provided that the underlying prob- 
ability space is rich enough to support a random variable which is uniformly distributed 
on [0, 1) and independent of {Zt)t&, the solution given by (12.151) is the unique strictly 
stationary solution of (II. ip if and only if det P{z) ^ for all z on the unit circle. 

Special cases of Theorem 12.21 are treated in Remarks 16.41 16.61 and Corollary 16.51 Ob- 
serve that for m = 1, Theorem 12.21 reduces to the corresponding result in Brockwell and 
Lindner [1]. Also observe that condition (iii) of Theorem 12.21 is not implied by condition 
(i), which can be seen e.g. by allowing a deterministic noise sequence {Zt)tez, in which 
case M{z) = 0. The proof of Theorem 12.21 will be given in Section [5] and will make use 
of both Theorem 12.11 and Theorem 12.31 given below. The latter is the corresponding char- 
acterization for the existence of weakly stationary solutions of ARMA(p, q) equations, 
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expressed in terms of the characteristic polynomials P{z) and Q{z). That det P{z) ^ 
for all z on the unit circle together with E(Zo) = is sufficient for the existence of weakly 
stationary solutions is well known, but that the conditions given below are necessary and 
sufficient in higher dimensions seems not to have appeared in the literature so far. The 



proof of Theorem 12.31 which is similar to the proof in the one-dimensional case, will be 
given in Section HJ 

Theorem 2.3. [Weak ARMA(p, q) processes] 

Let m,d,p G N, q G Nq, and let {Zt)tez be a weak white noise sequence in with 
expectation EZq and covariance matrix S. Let . . . , \l/p G C"^™ and Bq, . . . , G 
ij-^mxd^ and define the matrix polynomials P{z) and Q{z) by (11.21) . Let U G C'^^'^ be unitary 

such that UTjU* = [ s,d s \ where D is a real {s x s) -diagonal matrix with the 

strictly positive eigenvalues of J] on its diagonal for some s G {0,...,d}. (The matrix 
U exists since S is positive s emide finite) . Then the ARMA{p,q) equation (11.11) admits a 
weakly stationary solution {Yt)t& if and only if the 'C^^'^ -valued rational function 



z ^ M{z) := p-\z)Q{z)U* 



Ids ^s,d-s 



has only removable singularities on the unit circle and if there is some g G C™ such that 

P{l)g = Q{l)EZo. (2.16) 
In that case, a weakly stationary solution of (II. ip is given by 

oo 

Yt = g+ J2 UiZt-j - EZo), t G Z, (2.17) 

j=-oo 

where M{z) = X^^-oo^i-^"' ^■^ Laurent expansion of M{z) in a neighbourhood of the 
unit circle, which converges absolutely there. 

It is easy to see that if S in the theorem above is invertible, then the condition that 
all singularities of M{z) on the unit circle are removable is equivalent to the condition 
that all singularities of P^^{z)Q{z) on the unit circle are removable. 



3 Proof of Theorem 12.1 



In this section we give the proof of Theorem 12. 1[ In Section lSTD we show that the conditions 
(i) — (iii) are necessary. The suffiency of the conditions is proven in Section 13.21 while 
the uniqueness assertion is established in Section 13.31 
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3.1 The necessity of the conditions 



Assume that {Yt)tez is a strictly stationary solution of equation (II. 3p . As observed before 
Theorem 12. 1[ this implies that each of the equations (12. 5 p admits a strictly stationary 
solution, where X^'^^ is defined as in (12. Sp . Equation (12. 5p is itself an ARMA(1, q) equation 
with i.i.d. noise, so that for proving (i) - (iii) we may assume that H = 1, that S = Id^ 
and that $ := is an m x m Jordan block corresponding to an eigenvalue A. Hence we 
assume throughout Section EH] that 



g 

fc=0 



t e z. 



(3.1) 



has a strictly stationary solution with $ G C™^™ of the form (12. ip . and we have to show 
that this implies (i) if |A| ^ 0, 1, (ii) if |A| = 1 but A 7^ 1, and (iii) if A = 1. Before we 
do this in the next subsections, we observe that iterating the ARMA(l,g) equation (13. ip 
gives for n > g 

cj-l / j \ n-l / q \ 

j=0 \k=0 J j=q \k=0 / 

+ J2 <f ( E '^'"^k] ^t-(n+,) + $">^t-n. (3.2) 
j=0 \k=j+l J 

3.1.1 The case |A| G (0,1). 

Suppose that |A| G (0,1) and let e G (0, |A|). Then there are constants C,C' > 1 such 
that 



||$-^|| < C - |A|-^' - J™ < {C'){\X\-e)-^ for all j G IN, 
as a consequence of Theorem 11.1.1 in [8]. Hence, we have for all j G No and t G Z 



,A:=0 



< C'{\X\-e) 



t-j 



,k=0 



(3.3) 



Now, since lim„_>oo = and since (Yt)t^z and {Zt)tez are strictly stationary, an appli- 
cation of Slutsky's lemma to equation (13. 2p shows that 



9-1 



n-l 



t-j- 



(3.4) 



j=o 



,k=0 



3=1 



,k=0 



Hence the limit on the right hand side exists and, as a sum with independent summands, 
it converges almost surely. Thus it follows from equation (13. 3p and the Borel-Cantelli 
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lemma that 



< 



fc=0 



>c'{\M-^r' 



,fe=0 



> 1 < CX), 



and hence E (log^ ||(X]fc=o'^ '^©fc) ^o||) < oo. Obviously, this is equivalent to condition 
(i)- 

3.1.2 The case |A| > 1. 

Suppose that |A| > 1. Multiplying equation (13. 2p by gives for n > g 

9-1 / j \ n-q / q \ 

j=0 \k=0 J j=l \k=0 / 

+ [Yl '^"'©'t ) Zt-(n+,) + Yt-n- 

j=0 \k=j+l J 

Defining $ := and substituting u = t — n yields 

q—l / 1 \ n—q 



j=0 \fc=i+l / 3=1 \k=Q 

- E fE '^"'©'^ I ^«+«-^- + 



(3.5) 



j=o Vfc=o 

Letting n — )■ oo then gives condition (i) with the same arguments as in the case |A| G (0, 1). 

3.1.3 The case |A| = 1 and symmetric noise {Zt). 
Suppose that Zq is symmetric and that |A| = 1. Denoting 

Ji := $ - Aldm and Ji := j[ for j G No, 

we have 



m—l 



1=0 



since Ji = for / > m and (]) = for / > j. Further, since for / G {0, . . . , m — 1} we have 

Ji = (ez+ 
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with unit vectors e/+i, in C", it is easy to see that for i = 1, m the i*'* row of the 
matrix is given by 



m— 1 



1=0 



i-1 



1=0 



(3.6) 



It follows from equations (13. 2p and (13. 6 P that for n > g and t G Z, 



en-, 



j=0 \«=0 ^ ^ / \fc=0 / 



i=<? \i=o 

q-l 



t-j 



,k=0 



We claim that 



j=0 V«=0 ^ ^ / Vfc=i+1 / 

ef^<l>~^0feZt = O a.s. Vie{l,...,m} V t G Z, 



(3.7) 



(3.^ 



fc=0 



which clearly gives conditions (ii) and (iii), respectively, with a = ai = Om- Equation 
(13. 8p will be proved by induction on i = 1, . . . ,m. We start with i = 1. From equation 
(13. 7p we know that for n > g 



q-l 



j=0 



,k=0 



j=0 



Kk=j+1 



n-l 



(3.9) 



,k=0 



Due to the stationarity of iYt)te'E and {Zt)te'E, there exists a constant Ki > such that 



P 



q~l 



9-1 



vfc=0 



t-{n+j) 



j=0 



Kk=j+1 



< Ki] >- \/n>q. 



By (13. 9 p this implies 



P 



n-l 



J =9 



,fc=0 



< i^i 1 > - Vn > g. 



(3.10) 
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Therefore 



t-j does not converge in probability to +00 as 
n — )■ 00. Since this is a sum of independent and symmetric terms, this imphes that it 
converges almost surely (see Kallenberg [6], Theorem 4.17), and the Borel-Cantelli lemma 
then shows that 



,fc=0 



which is (13.81) for i = 1. With this condition, equation (13. 9p simplifies for t = and n > q 

to 

i=o Vfc=o / j=o \fc=i+i / 

Now setting t := —n in the above equation, multiplying it with A* = A^" and recalling 
that ej^^ = A^ef by yields for t < -g 



q-l 



y-1 



j=0 \k=j+l J \ j=0 \A;=0 

For the induction step let i G {2, . . . , m} and assume that 

'^^-''Qk] Zt = a.s., r e {!,..., t G Z, 



(3.11) 



,A:=0 



together with 



1^ ■ / t \ 0, r E {l,...,i-2}, t< -rq. 

j=o \k=j+i J [A K-, r = t-l,t< -rq, 

where 



Vr := A(^'-i)^ ( l^-(.-i), - Yl ( E *~'©'^ ) ^-^-ir-i), ) > r G {1, . . . , m}. 

\ j=0 \k=0 

We are going to show that this implies 



^^-'^Ofc ]Zt = a.s., t G Z, 



(3.13) 



vfc=0 



and 



9-1 / 9 

ef^^t = -eJJ2<^>nJ2'^''^k]Zt., + X'eJV,e..s., t < -iq, (3.14) 

j=0 \fc=i+l 
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together with 

eUV.^i = 0. (3.15) 

This will then imply (13. 8p . For doing that, in a first step we are going to prove the 
following: 

Lemma 3.1. Let i G {2, . . . ,m} and assume ^3.11\) and ^3.12^) . Then it holds for t < 
— {i — l)q and n> q, 

q-l / j \ n-l / q \ 

j=0 \A:=0 / j=q \k=0 J 

+X^J2eJ<l>^ ( J2 '^'"^k] +nA*-ief_ir,_i, (3.16) 

j=0 \k=j+l J 

Proof. Let t < —{i — l)q and n > q. Using (13.121) and (13. 6p . the last summand of (13. 7p 
can be written as 

■ t—n 



r=l 

(J— 1 / j— 1 7 1 



Avfr..„-i: i:i:(^)r^ )A''-'--'>v-'er, e 

j=0 \r=l i=0 ^ ^ ^ ^ / \k=j+l J 



t-{n+j) 



j=0 \s=l ^ ^ / \k=j+l / 

+^" E(E(')^^"^^rJ (E $-'^e,')z,_(„_,,)+nA*-ef_,K._„ 



j=0 \s=l ^ ^ / \fe=j+l 



where we substituted s := i — r + I and p := s — I and used Vandermonde's identity 
Sp=i is- ) (") ~ ("t"') ^ (s) ^'^^ ^^^^ equation. Inserting this back into equation (13.70 
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and using f l3.1ip . we get for t < —{i — l)q and n > q 



j=0 \l=0 
n-1 



,k=0 



q-l 



t-(n+j) 



j=g \fc=0 
j=0 \s=l 



j=0 \k=j+l 
\k=j+l J 



An application of (13.61) then shows (13.161) . completing the proof of the lemma. 



□ 



To continue with the induction step, we first show that (I3.15P holds true. Dividing 
(I3.16P by n and letting ri — )■ oo, the strict stationarity of {Yt)tez and {Zt)tez imply that 
for t < — (i — l)g, 



n 



t-j 



3=1 



.fe=0 



converges in probability to —\^~^eJ_^Vi^i. On the other hand, this limit in probability 
must be clearly measurable with respect to the tail-a-algebra nfcg]Ncr(Ui>fccr(Zt_i)), which 
by Kolmogorov's zero-one law is P-trivial. Hence this probability limit must be constant, 
and because of the assumed symmetry of Zq it must be symmetric, hence is equal to 0, 
i.e. 

ef_iV^i_i = a.s., 
which is (I3.15p . Using this, we get from Lemma [3.11 that 



q-l 



q-l 



j=0 



n-1 



t-in+j) 



(3.17) 



,k=0 



Again due to the stationarity of (Fj^g^ and (Zt)tez there exists a constant K2 > such 
that 



P 



g-l 



ejY, - A"ef - ^ ej<^^ J2 ^"'©^' ) 

j=0 \k=0 



q-l 



t-{n+j) 



j=0 



\k=j+l 



< 1^2 I > - V n > g. 
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so that 



n — 1 



<K2]>- yn>q, t<-{t-l)q. 



j=q \k=0 J 

Therefore |E;4 ^'^HELo "^""©fc) ^t-i does not converge in probabihty to +00 as 
— )■ 00. Since this is a sum of independent and symmetric terms, this imphes that it 
converges almost surely (see Kallenberg [B], Theorem 4.17), and the Borel-Cantelli lemma 
then shows that ef {Ylt=o ^~*^©A:) Zt = a.s. for t < —{i — l)g and hence for all t G Z, 
which is fl3.13p . Equation fl3.17p now simplifies for t = —{i — l)q and n > g to 

ef YL(i_i)g - A"efF„(i_i)g_„ 

j=o Vfc=o / j=o \fc=i+i / 

Multiplying this equation by A~" and denoting t := — (i — l)q — n, it follows that for 
t < —iq it holds 



q-l 



t-j 



j=0 



\k=j+l 



q-l 



)9 



i=o 



,fc=0 



g-1 



-E^^^M E ^-'Qk)z,., + X'eJV., 

j=0 \k=j+l 



which is equation f l3.14p . This completes the proof of the induction step and hence of 
f l3.8p . It follows that conditions (ii) and (iii), respectively, hold with cti = if |A| = 1 and 
Zq is symmetric. 



3.1.4 The case |A| = 1 and not necessarily symmetric noise (Zt). 



As in Section [3.1.31 assume that |A| = 1, but not necessarily that Zq is symmetric. Let 
(F/, ^jOfez be an independent copy of (Ft, Zt)t& and denote Yt := F^ — F/ and Zt := Zt — Z[. 
Then <(Yi)t& is a strictly stationary solution of Yt - $Fi_i = XlLo ^kZt-k, and {Zt)t(zz is 
i.i.d. with Zq being symmetric. It hence follows from Section [3. 1.31 that 



,fc=0 



,fc=0 



,fc=0 



Since Zq and Zq are independent, this implies that there is a constant a G C™' such that 
Yl'k=o^'^ '''^kZo = a a.s., which is (12.81) . hence condition (ii) if A 7^ 1. To show condition 
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(iii) in the case A = 1, recall that the deviation of fl3.10p in Section [3.1.31 did not need 
the symmetry assumption on Zq. Hence by fl3.10p there is some constant Ki such that 
P(| X]j=g I'^efal < Ki) > 1/2 for all n > q, which clearly implies eja = and hence 
condition (iii). 



3.2 The sufficiency of the conditions 



Suppose that conditions (i) — (iii) are satisfied, and let X^^\ t ^ Z, h E {1, . . . , H}, 
be defined by I^M>- The fact that xf ^ as defined in I^M) converges a.s. for \Xh\ G (0,1) 
is in complete analogy to the proof in the one-dimensional case treated in Brockwell 
and Lindner [1], but we give the short argument for completeness: observe that there are 
constants a,b > such that ||$;^|| < ae~^^ for j G Nq. Hence for b' G (0, b) we can estimate 



J2r 



j=q 



< 



k=0 



> e 



log-^ 



J=<? 



k=0 



> {b-b'){]-q) < oo. 



the last inequality being due to the fact that 



Y.l=,K-'hs-'QkZ^^ 



has the same 



distribution as 



ELo K'hS-^QkZ, 



and the latter has finite log- moment by (12.71) . 

The Borel-Cantelli lemma then shows that the event {^^^h'^Yl'k=o^V^^hS~^'dkZt-j^ > 
Q-b'ij-q) ^Qj- infinitely many j} has probability zero, giving the almost sure absolute con- 
vergence of the series in (12. 9p . The almost sure absolute convergence of (12. 9 p if |A/i| > 1 
is established similarly. 

It is obvious that {{xj:^^'^ , . . . , xj:^^'^)'^)t^x as defined in (12. 9p and hence {Yt)t(ii defined 
by (12. 6 p is strictly stationary, so it only remains to show that {x['^^)t<^i solves (12. 5 p for each 
/i G {1, . . . , H}. For |A/i| 7^ 0, 1, this is an immediate consequence of (12. 9p . For \Xh\ = 1, 
we have by (12. 9p and the definition of fh that 



xt^ - 



"'^ + E E K''hs-'QkZ,^, - E K''hs-'ekZ,., 

j=0 k=0 j=l k=0 

q-1 q-1 

aH + J2 hS-'e,Zt_j - K'^hS-^^kZt-q 



j=0 

hs-'Y.^,z,_ 

3=0 



k=0 
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where the last equality follows from (12. 8p . Finally, if \h 
implying that xf''^ defined by (12. 9p solves (12. 5p also in this case. 



0, then 



for j > m, 
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3.3 The uniqueness of the solution 

Suppose that \\h\ 7^ 1 for all h E {1,...,H} and let (Yt)tez be a strictly stationary- 
solution of dH. Then (xf ^) t(zz, as defined by fl2.3p . is a strictly stationary solution of 
(12. 5 p for each h G {1, . . . , H}. It then follows as in Section 13.1.11 that by the equation 
corresponding to (13. 4p . xj:'^^ is uniquely determined if |A/i| G (0,1). Similarly, X^^^ is 
uniquely determined if \Xh\ > 1. The uniqueness of xj:'^^ if = follows from the 
equation corresponding to ( 13. 2p with n > m, since then = for j > m. We conclude 
that {{X^^^'^ , . . . , xj:^'^'^)'^)t(zz is unique and hence so is {Yt)tei,- 

Now suppose that there is h G {1, . . . , H} such that \Xh\ = 1. Let U he a random 
variable which is uniformly distributed on [0, 1) and independent of {Zt)ti=z- Then {Rt)t^z, 
defined by Rt := A^(0, . . .0,e^'^*^)"^ G C'^+i"^'', is strictly stationary and independent of 
{Zt)tez and satisfies Rt — ^uRt-i = 0. Hence, if {Yt)t£Z is the strictly stationary solution 
of (O]) specified by (ES]) and (EE]), then 

Yt + ^(O^^-ri^ • • • 5 0^^_^^_^, i?f , 0^^_j^2_r^_^^, . . . , 0^^^^_^^)^, t G Z, 
is another strictly stationary solution of (II. 3p . violating uniqueness. 



4 Proof of Theorem 2.3 



In this section we shall prove Theorem 12.31 Denote 

R :=U*{ ^^'^ I and Wt := (^'^'^ ^^'""^ | f/(Z, - EZq), t G Z, 

yO^-s^s Od-s,d-s J \Od-s,s Od-s,d-s J 

where D^^'^ is the unique diagonal matrix with strictly positive eigenvalues such that 
^j-)i/2^2 _ Then {Wt)t& is a white noise sequence in with expectation and 

covariance matrix | ^''^ | . It is further clear that all singularities of M[z) on 

yOrf-s^s ^d-s,d-s j 

the unit circle are removable if and only if all singularities of M'{z) := P~^{z)Q{z)R on 
the unit circle are removable, and in that case, the Laurent expansions of both M{z) and 
M'{z) converge almost surely absolutely in a neighbourhood of the unit circle. 

To see the sufficiency of the condition, suppose that (12.160 has a solution g and that 
M{z) and hence M'{z) have only removable singularities on the unit circle. Define Y = 
iYt)tez by dZIID, i-e. 

°° ( D^/"^ \ 
Ft = + MJ ^'"-^ Wt^, =g + M'{B)Wt, t G Z. 

j=—oo \ 'i—S'^ ^d—s,d—s j 



18 



The series converges almost surely absolutely due to the exponential decrease of the 
entries of Mj as |j| — i- oo. Further, Y is clearly weakly stationary, and since the last 
{d — s) components of U {Zt — IEZq) vanish, having expectation zero and variance zero, it 
follows that 

RWt = U* ( /"^^ ) UiZt - EZo) = U*U{Zt - EZo) = - EZq, t E Z. 

We conclude that 

P{B){Yt -g) = P{B)M'{B)Wt = P{B)p-\B)Q{B)RWt = Q{B){Zt - EZq), t G Z. 

Since P{l)g = Q{1)KZq, this shows that {Yt)t(^i is a weakly stationary solution of (11. II) . 

Conversely, suppose that Y = {Yt)tei is a weakly stationary solution of (11. ip . Taking 
expectations in (11.11) yields P(l)Elo = <5(l)IEZo, so that (12.161) has a solution. The 
C'^^'^-valued spectral measure /xy of Y satisfies 

P{e~'^) diiY^oj) P{e-'^y = — Q(e-^'^)Sg(e-^^)* du, u e (-vr, tt]. 

It follows that, with the finite set N := {cu E (-tt, tt] : P{e-''^) = 0}, 

d^iyico) = ^p-i(e-^'^)g(e-*^)SQ(e-*")*p-i(e-^^)* dco on (-tt, tt] \ A^. 

Observing that RR* = S, it follows that the function u ^ M'(e-*'^)M'(e"*'^)* must be 
integrable on (— vr, tt] \ A^. Now assume that the matrix rational function M' has a non- 
removable singularity at zq with l^ol = 1 in at least one matrix element. This must then 
be a pole of order r > 1. Denoting the spectral norm by || ■ II2 it follows that there are 
e > and > such that 

\\M'{zy\\2 >K\z-Zo\-'^ V 2 G C : 1^1 = 1, z ^ zq,\z - zo\ < e; 

this may be seen by considering first the row sum norm of M'{z)* and then using the 
equivalence of norms. Since the matrix M'{z)M'{z)* is hermitian, we conclude that 

\\M'{z)M'{zy\\2= sup \v*M'{z)M'{zyv\ = sup {M'izyvl'^ > K^\z - zqI"^ 

veC^:\v\ = l veC":\v\ = l 

for all z ^ Zq on the unit circle such that I2; — zqI ^ ^- But this implies that u H- 
M'(e~*'^)M'(e~*'^)* cannot be integrable on (— 7r,7r] \ A^, giving the desired contradiction. 
This finishes the proof of Theorem 12.31 



19 



5 Proof of Theorem 



2.2 



In this section we shall prove Theorem 12.21 For that, we first observe that ARMA(p, g) 
equations can be embedded into higher dimensional ARMA(1, q) processes, as stated in 
the following proposition. This is well known and its proof is immediate, hence omitted. 

Proposition 5.1. Let m,d,p e N, g G No, and let {Zt)tez be an i.i.d. sequence of C^- 
valued random vectors. Let \E'i, . . . , \E'p G C'"^™' and Bq, . . . , Oq G C'"^'^ he complex-valued 
matrices. Define the matrices $ G C™^^"^^ and 6^ G C^p^'^^ k e {0, . . . , g}, by 



Id, 




Om.m. 



m,m 



0. 



and Qi 



i.m j 



/ <S>k\ 



(5.1) 



Then the ARMA{p, q) equation ( II. ip admits a strictly stationary solution (Yt)tez of m- 
dimensional random vectors Yt if and only if the ARMA{l,q) equation 



Yt - $ = e^Zt + &,Zt-i + ...+ %Zt-q, t G z. 



(5.2) 



admits a strictly stationary solution {Y_^tez of mp- dimensional random vectors Y_^. More 
precisely, if {Ytjtei ^■^ a strictly stationary solution of (11.11) . then 



(p-i)) Jtez 



(5.3) 



is a strictly stationary solution of (15. 2p . and conversely, if{Y_i)t& = {iXt 



(1)T 



. . . , 



1 t 



Itez 



with random components Y^ 



(i) 



is a strictly stationary solution of (15. 2p . then {Yt)tez '■- 



{Y^ )tez is a strictly stationary solution of (II. ip . 

For the proof of Theorem 12.21 we need some notation: define $ and as in (15. ip . 
Choose an invertible matrix S_ such that S_~^^S_ is in Jordan canonical form, 

with H Jordan blocks . . . ^^Jy Jordan block $^ starting in row r^^, with 

:= 1 < < • ■ ■ < rji^ < mp + 1 =: r^+i- Let A;^ be the eigenvalue associated with 
and, similarly to (12. 4p . denote by the {ri^_^_-^^ — r_i^ x mp-matrix with components 
Lhihj) = 1 if J = ^ + ZL/i "~ 1 and Lhi'^^j) — otherwise. For /i G {1, . . . , H} and j G Z let 



N. 



'-jG{0,...,mp+q 



^je{0,...,q- 



IAJe(o,i), 
lAJ > 1, 
A. = o, 

lAJ = 1, 



20 



and 

AT. := S-\Nf^,, . . . , Nj^^f G C"^^^''. (5.4) 
Further, let U and K be defined as in the statement of the theorem, and denote 

Wt := UZt, t G Z. 

Then {Wt)t<^i is an i.i.d. sequence. Equation fl2.12p is then an easy consequence of the fact 
that for a G C"' the distribution of a*WQ = {U*a)*ZQ is degenerate to a Dirac measure if 
and only if U*a G K, i.e. if a G UK = {0^} x C^^"*: taking for a the i*'* unit vector in for 
2 G {s + 1, . . . , d}, we see that Wt must be of the form {wf, m^)^ for some u G C^^*, and 
taking a = (6^, Oj_ for 6 G we see that b*wo is not degenerate to a Dirac measure 
for 6 7^ Og. The remaining proof of the necessity of the conditions, the sufficiency of the 
conditions and the stated uniqueness will be given in the next subsections. 

5.1 The necessity of the conditions 

Suppose that (Yt)t£z is a strictly stationary solution of f ll.ip . Define by (15. 3p . Then 
iY.t)t€Z is a strictly stationary solution of f l5.2p by Proposition 15. II Hence, by Theorem 12. 11 
there is /' G C"^, such that {Y^t)t£Z, defined by 

oo 
j=-oo 

is (possibly another) strictly stationary solution of 

k=0 k=0 

where B^, := Q^U*. The sum in (15. 5p converges almost surely absolutely. Now define 
Ah G C'^^h+i-Lj^^ and Ch G C^^'^+i'^'^^^^'^"^) for /i G {1, . . . , H} such that |AJ = 1 by 

iAh,Ch):=J2^k''hS-'Q,. (5.6) 

A;=0 

By conditions (ii) and (iii) of Theorem 12. H for every such h with \Xf^\ = 1 there exists a 
vector = (a/i^i, . . . , Cih,r^^j^-r,J'^ ^ C-'^+i"-'' such that 

iAh,Ch)Wo = a.s. 

with ah^i = if = 1. Since Wq = {wq,u'^)'^, this implies AhWo = — ChU, but since 
b*wo is not degenerate to a Dirac measure for any 6 G C \ {Og}, this gives A/i = and 
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hence ChU = for /i G {1, . . . , H} such that |A^| = 1. Now let G C'^ and {W")t(zz be an 
i.i.d. A^(| ^ I , I I )-distributed sequence, and let Z'/ := U*W;'. Then 



{Ah,Ch)W;; = ChU = ah a.s. for h e {1, . . . , H} : \X^\ = 1 

and 



Elog^ 



fc=0 



< oo for he{l,...,H} -.IXf^l^O,!. 



It then follows from Theorem 12.11 that there is a strictly stationary solution of the 
ARMA(1, q) equation H^'-^ F^i = ELo ®fc^/-fc = ELo ©fc^t-fc. ^hich can be written 
in the form Fj' = /" + Y.T=-ooKjZ'{_j for some /" G C'"?'. In particular, (rOiGZ is a 
Gaussian process. Again from Proposition 15.11 it follows that there is a Gaussian process 
(y/')tgz which is a strictly stationary solution of 

k=l k=0 k=0 

In particular, this solution is also weakly stationary. Hence it follows from Theorem 12.31 
that z M{z) has only removable singularities on the unit circle and that (12.141) has a 
solution g G C™', since EZq = U*{v^ ,u^)^ . Hence we have established that (i) and (iii'), 
and hence (iii), of Theorem 12.21 are necessary conditions for a strictly stationary solution 
to exist. 

To see the necessity of conditions (ii) and (ii'), we need the following lemma, which 
is interesting in itself since it expresses the Laurent coefficients of M[z) in terms of the 
Jordan canonical decomposition of $. 

Lemma 5.2. With the notations of Theorem \2.S\ and those introduced after Proposi- 
tion l5Al suppose that condition (i) of Theorem \2.2\ holds, i.e. that M{z) has only re- 
movable singularities on the unit circle. Denote by M{z) = Ejl-oo Mjz^ the Laurent 
expansion of M{z) in a neighborhood of the unit circle. Then 

M^:={Mj,Mj_„...,Mj^^^,r = N^U*(^^' ] VjgZ. (5.7) 



d—s,s ^d—s,d—s 



In particular, 



MnZt-, = N^Zt-, - iV,[/*(Of , u'^f M 3,te Z. (5.^ 



Proof. Define A := ( ^"''^ " ) and let {Z[)tez be an i.i.d. A^(Od, [/*Af/)-distri- 

buted noise sequence and define F/ := Ejl-oo ^i^^t-j- Then (F/)fgz is a weakly and 
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strictly stationary solution of P{B)Y^ = Q{B)Z[ by Theorem 12.31 and the entries of Mj 
decrease geometrically as |j| — > oo. By Proposition I5.H the process (llt)tGZ defined by 



n = {Yf,Yu 



~ Sjl-oo — i^-^i-j ^ strictly stationary solution of 



i=o 



Denoting 9^. = 0^^,^ for j G Z\ {0, . . . , g}, it follows that Er=-oo(Mfc -^Mfc-i)f/^;_fc = 
Y^=-oo ^k^t-ky ^^cl multiplying this equation from the right by Z'J_j, taking expectations 
and observing that M{z)A = M{z) we conclude that 



(M . - $ M _i)f/ = (M . - $ M . i)A[/ = e.U*AU W j E Z. 



(5.10) 



Next observe that since {Xlt)t& is a strictly stationary solution of (15. 9p . it follows from 
Theorem 12.11 that {Y^Dtez-, defined by Y^l = Yl'jL-oo^j^i-j^ ^^^o ^ strictly stationary 
solution of (15. 9p . With precisely the same argument as above it follows that 



{Kj - ^Kj^i)U*AU = QjU*AU V J G z. 



(5.11) 



Now let Lj := Mj-NjU*A, j G Z. Then Lj -^Lj^i = O^p,^ from f l510|) and f lSTT]) . and 
the entries of Lj decrease exponentially as |j| — )■ oo since so do the entries of M j and 
It follows that for /i G {1, . . . , H} and j E 1j we have 





/ 




\ 




\ 
















\ 


\ 









'-h+l 



^4- (5.12) 



Since is invertible for h G {l,...,if} such that ^ 0, this gives Lq = 

^h^LhS'^Lj for all j G Z and A^, ^ 0. Since for |A;,| > 1, < kJ'^p for all j G Nq for 

some constant k, it follows that ||//i5~^Ivo|| < i^j"^^\\Lh^~'^ which converges to as 
j — 7- oo by the geometric decrease of the coefficients of Lj as j — )■ oo, so that I_h^^^k = 
for I Aft I ^ 1 s-iid k = and hence for all k E 1^. Similarly, letting j — > — oo, it follows 
that Lh^^^^k = for G (0,1) and k = Q and hence for all A; G Z. Finally, for 



observe that LhST^Lk = ^ThS-^L 



^rhS-'Lk-rr.p ioikeZ by 



/i G {1, . . . , H} such that A^^ 
(I5.12p . and since = 0, this shows that LhS^^L^ = for G Z. Summing up, we have 
S'^Lk = and hence = Nf.U*A for A; G Z, which is dE?]). Equation (^M> then follows 
from (I2.12p . since 



M^UZ,. 



Wt-j 

u 



NjU* 





□ 
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Returning to the proof of the necessity of conditions (ii) and (ii') for a strictly station- 
ary solution to exist, observe that Y^JL-oo—j^t-i converges almost surely absolutely by 
(15. 5p . and since the entries of N_j decrease geometrically as \j\ — )• oo, this together with 
flS.Sp implies that Yl'jL-oo M-jU Zt_j converges almost surely absolutely, which shows that 
(ii') must hold. To see (ii), observe that for j > mp + g we have 



while 



^H-'n=o^r'hs~'e„ iAjG(o,i), 

0, IAJ^(o,i), 



0, |AJ < 1. 



Since a strictly stationary solution of (15. 2 p exists, it follows from Theorem 12.11 that 
Elog"*" ||iVjZo|| < oo for j > mp + q and Elog^ ||i\[-i^o|| < oo. Together with (15. 8p 
this shows that condition (ii) of Theorem 12.21 is necessary. 



5.2 The sufficiency of the conditions and uniqueness of the so- 
lution 

In this subsection we shall show that (i), (ii), (iii) as well as (i), (ii'), (iii) of Theorem 12.21 
are sufficient conditions for a strictly stationary solution of (II. ip to exist, and prove the 
uniqueness assertion. 

(a) Assume that conditions (i), (ii) and (iii) hold for some f G and g G C™". Then 
Elog"*" ||iV_]^Zo|| < oo and Elog^ ||i\[mp+g^o|| < oo by (ii) and (15. 8p . In particular, since 
S_ is invertible, Elog"*" ||A^_i^/iZo|| < oo for |A^| > 1 and Elog"*" ||A^mp+(j,h-^o|| < oo for 
|A/j| G (0, 1). The invertibility of for A/^ 7^ then shows that 



Elog-^ 



k=0 



< 00 V/i G {!,..., iJ} : |A^| G (0,1) U (l,cx)). (5.13) 



Now let {Wl")tez be an i.i.d. Ar( I ^ ) , I ' ) distributed sequence and 

Od-s,s Od-s,d-s j 

define := WW^" . Then EZf = U*{v^,u^Y. By conditions (i) and (in) and Theo- 
rem {Ynt&. defined by F/" := P{l)-^Q{l)^Z'^ + Er=-oo^.W-, " i^^ .^^Y). is 
a weakly stationary solution of F/" — Y7k=i ^kYt-k — X]fc=o ^kZ'tLki and obviously, it is 
also strictly stationary. It now follows in complete analogy to the necessity proof pre- 
sented in Section ISTT] that Ah = Q and ChU = {ah^i, ■ ■ ■ ; ct/i.r^+i-r^)^ ^^i {X^l = 1, where 
{Ah,Ch) is defined as in (15. 6p and ah,i = if A/i = 1. Hence Ylk=o—ir''Lh^'^^k^o = 
{ah,i, . . . , Q^fe,r^ , i-r^)"^ ioT \Xh\ = 1. By Theorem 12.11 this together with (I5.13p implies the 
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existence of a strictly stationary solution of f l5.2p . so that a strictly stationary solution 
(Xt)tez of (11.11) exists by Proposition 15.11 

(b) Now assume that conditions (i), (ii') and (iii) hold for some f G and g G C™ and 
define Y = {Yt)t&z by fl2.15p . Then Y is clearly strictly stationary. Since UZt = {wf,u'^), 
we further have, using (iii), that 

P{B)Y, = P{l)g - P(1)M(1) f ^ ) + Q{B)W { J^^^ V 

\ M y \ y^d-s,s y^d-s,d-s J \ ^ J 

- w)^-(:)-w)f/-(o:j^««)^'(o:.) 

= Q{B)U* j = Q(B)Z, 

for t G Z, so that {Yt)t^i is a solution of fll.ll) . 

(c) Finally, the uniqueness assertion follows from the fact that by Proposition 15. H 
(II. ip has a unique strictly stationary solution if and only if (15. 2p has a unique strictly 
stationary solution. By Theorem 12. H the latter is equivalent to the fact that $ does not 
have an eigenvalue on the unit circle, which in turn is equivalent to detP(z) 7^ for z 
on the unit circle, since det P(2;) = det(Idmp — ^z) (e.g. Gohberg et al. [7], p. 14). This 
finishes the proof of Theorem 12.21 



6 Discussion and consequences of main results 



In this section we shall discuss the main results and consider special cases. Some conse- 
quences of the results are also listed. We start with some comments on Theorem 12.11 If 
\E'i has only eigenvalues of absolute value in (0, 1) U (1, 00), then a much simpler condition 
for stationarity of (11.30 can be given: 



Corollary 6.1. Let the assumptions of Theorem \2.1\ he satisfied and suppose that '^i has 
only eigenvalues of absolute value in (0, 1) U (1, 00). Then a strictly stationary solution of 
(II. 3p exists if and only if 



Elog"* 



< 00. 



(6.1) 



Proof. It follows from Theorem 12.11 that there exists a strictly stationary solution if and 
only if (12. 7p holds for every h & {1, . . . , H}. But this is equivalent to 



Elog+ ||(^(5-iM/i5)^-'=Id„5-ie,)Zo|| < 00, 



fc=0 
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which in turn is equivalent to (16. ip . since S is invertible and hence for a random vector 
G we have Elog+ \\SR\\ < cx) if and only if Elog+ < oo. □ 

Remark 6.2. Suppose that \E'i has only eigenvalues of absolute value in (0, 1) U (1, oo). 
Then Elog^ ll^oll is a sufficient condition for (II. 3p to have a strictly stationary solution, 
since it implies (16. ip . But it is not necessary. For example, let q = 1, m = d = 2 and 

*i=(^Q 3^, eo = Id2, 0i=(^~/ so that Y.n-'Qk = 

By (16. ip . a strictly stationary solution exists for example if the i.i.d. noise {Zt)tez satisfies 
Zq = {Rq, Rq + R'q)'^ , where R'q is a random variable with finite log moment and Rq a 
random variable with infinite log moment. In particular, Elog"^ ll^oll = oo is possible. 

An example like in the remark above cannot occur if the matrix X]fc=o is 
invertible if m = ci. More generally, we have the following result: 

Corollary 6.3. Let the assumptions of Theorem \2.1\ be satisfied and suppose that \E'i has 
only eigenvalues of absolute value in (0, 1) U (1, oo). Suppose further that d <m and that 
X]fc=o ^I'^^Qfc has full rank d. Then a strictly stationary solution of (11.30 exists if and 
only i/Elog"*" ||Zo|| < oo. 

Proof. The sufficiency of the condition has been observed in Remark 16. 2[ and for the 
necessity, observe that with A := Yl'k=o ^i^^Qfe and U := AZq we must have E log^ \\U\\ < 
oo by (16. ip . Since A has rank d, the matrix A'^A G C'^^'^ is invertible and we have 
Zq = {A'^A)~^A'^U, i.e. the components of Zq are linear combinations of those of U. It 
follows that Elog^ ||Zo|| < oo. □ 

Next, we shall discuss the conditions of Theorem 12.21 in more detail. The following 
remark is obvious from Theorem 12.21 It implies in particular the well known fact that 
Elog''^ 11^0 II < oo together with det P{z) ^ for all z on the unit circle is sufficient for 
the existence of a strictly stationary solution. 

Remark 6.4. (a) Elog^ ll^oll < oo is a sufficient condition for (ii) of Theorem \2.S[ 

(b) detP(l) ^ Q is a sufficient condition for (Hi) of Theorem \2.S[ 

(c) detP(z) 7^ for all z on the unit circle is a sufficient condition for (i) and (Hi) of 
Theorem \2.2[ 

With the notations of Theorem 12.21 denote 

Q{z) := Qiz)U* ( ^'-^ V (6.2) 
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so that M{z) = P^^{z)Q{z). It is natural to ask if conditions (i) and (iii) of Theorem 12.21 
can be replaced by a removability condition on the singularities on the unit circle of 
{det P{z))~^ det{Q{z)) if d = m. The following corollary shows that this condition is 
indeed necessary, but it is not sufficient as pointed out in Remark I6.6[ 

Corollary 6.5. Under the assumptions of Theorem \2.1{ with Q{z) as defined in (16.21) . a 
necessary condition for a strictly stationary solution of the ARMA{p, q) equation (11.11) to 
exist is that the function z i— )■ | det P{z)\~'^dei{Q{z)Q{z)*) has only removable singularities 
on the unit circle. If additionally d = m, then a necessary condition for a strictly stationary 
solution to exist is that the matrix rational function z t— )■ {del P{z))~^ (let{Q{z)) has only 
removable singularities on the unit circle. 

Proof. The second assertion is immediate from Theorem [221 ^"^^ the first assertion follows 
from the fact that if M{z) as defined in Theorem 12.21 has only removable singularities on 
the unit circle, then so does M{z)M{z)* and hence dei{M{z)M{z)*). □ 

Remark 6.6. In the case d = m and Elog^ ll^oll < oo, the condition that the matrix 
rational function z h-t- {det P{z))^^det Q{z) has only removable singularities on the unit 
circle is not sufficient for the existence of a strictly stationary solution of i \1.3\} . For 

example, let p = q = 1, m = d = 2 and \l'i = 0o = Id2, ®i ~ ^ (^*)tez be 

i.i.d. standard normally distributed and U = Id2. Then det P{z) = detQ{z) = (1 — z)"^ , 
but it does not hold that \I^i6o + ©i = 0, so that condition (iii) of Theorem \2.1\ is violated 
and no strictly stationary solution can exist. 

Next, we shall discuss condition (i) of Theorem 12.21 in more detail. Recall (e.g. Kailath 
^) that a C"^^™ matrix polynomial R{z) is a left-divisor of P{z), if there is a matrix 
polynomial Pi{z) such that P{z) = R{z)Pi{z). The matrix polynomials P{z) and Q{z) 
are left-coprime, if every common left-divisor R{z) of P{z) and Q{z) is unimodular, i.e. the 
determinant of R{z) is constant in z. In that case, the matrix rational function P~^{z)Q{z) 
is also called irreducible. With Q as defined in (16.21) . it is then easy to see that condition 
(i) of Theorem 12.21 is equivalent to 

(i') There exist C^^"^ -valued matrix polynomials Pi{z) and R{z) and a Q'^^'^ -valued 
matrix polynomial Qi{z) such that P{z) = R{z)Pi{z), Q{z) = R{z)Qi{z) for all 
z & C and det Pi {z) ^ for all z on the unit circle. 

That (i') implies (i) is obvious, and that (i) implies (i') follows by taking R{z^ as 
the greatest common left-divisor (cf. [5], p. 377) of P{z^ and Q{z\ The thus remaining 
right-factors P\{z^ and Q\{z^ are then left-coprime, and since the matrix rational function 
M(z) = P^^{z)Q{z) = Pi^{z)Qi{z) has no poles on the unit circle, it follows from page 
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447 in Kailath [5j that det Pi{z) ^ for all z on the unit circle, which establishes (i'). As 
an immediated consequence, we have: 

Remark 6.7. With the notation of the Theorem and fl6.2p . assume additionally 
that P{z) and Q{z) are left-coprime. Then condition (i) of Theorem \2.2\ is equivalent 
to det P{z) 7^ for all z on the unit circle. 

Next we show how a slight extension of Theorem 4.1 of Bougerol and Picard [2], 
which characterized the existence of a strictly stationary non-anticipative solution of the 
ARMA(p, g) equation (11. ip . can be deduced from Theorem 12.21 By a non-anticipative 
strictly stationary solution we mean a strictly stationary solution Y = {Yt)t(^z such that 
for every t E Z, Yf is independent of the sigma algebra generated by {Zs)s>t, and by a 
causal strictly stationary solution we mean a strictly stationary solution Y = {Yt)tez such 
that for every t G Z, is measurable with respect to the sigma algebra generated by 
{Zs)s<t- Clearly, since {Zt)t£z is assumed to be i.i.d., every causal solution is also non- 
anticipative. The equivalence of (i) and (iii) in the theorem below was already obtained 
by Bougerol and Picarcd [2] under the additional assumption that Elog''" ||Zo|| < oo. 

Theorem 6.8. In addition to the assumptions and notations of Theorem assume 
that the matrix polynomials P{z) and Q{z) are left-coprime, with Q{z) as defined in (16. 2p . 
Then the following are equivalent: 

(i) There exists a non-anticipative strictly stationary solution of ( 11. ip . 
(a) There exists a causal strictly stationary solution of (II. ip . 

(iii) det P(z) ^ for all z ^ C such that \z\ < 1 and if M{z) = Yl'jLo^j^'' denotes the 
Taylor expansion of M{z) = P^^{z)Q{z) , then 

Elog^ ||M,f/Zo|| < oo V j G {mp + g — p + 1, . . . , mp + g}. (6.3) 

Proof. The implication "(iii) =^ (ii)" is immediate from Theorem 12.21 and equation (12.150 . 
and "(ii) =^ (i)" is obvious since {Zt)tez is i.i.d. Let us show that "(i) =^ (hi)": since 
a strictly stationary solution exists, the function M{z) has only removable singularities 
on the unit circle by Theorem 12.21 Since P{z) and Q{z) are left-coprime, this implies 
by Remark 16.71 that det P{z) ^ for all z G C such that \z\ = 1. In particular, by 
Theorem l2.2| the strictly stationary solution is unique and given by (I2.15p . By assumption, 
this solution must then be non-anticipative, so that we conclude that the distribution of 
MjUZt-j must be degenerate to a constant for all j G { — 1, —2, . . .}. But since UZq = 
{wq^u^Y and Mj = (Mj,Om^d_s) with certain matrices Mj G C™''', it follows for j < — 1 
that MjUZq = M'jWq, so that Mj = since no non-trivial linear combination of the 
components of wo is constant a.s. It follows that Mj = for j < —1, i.e. M{z) has only 
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removable singularities for \z\ < 1. Since P{z) and Q{z) are assumed to be left-coprime, 
it follows from page 447 in Kailath [5] that (\.eiP{z) ^ for all \z\ < 1. Equation (16. 3p is 
an immediate consequence of Theorem 12.21 □ 



It may be possible to extend Theorem 16.81 to situations without assuming that P{z) 
and Q{z) are left-coprime, but we did not investigate this question. 

The last result is on the interplay of the existence of strictly and of weakly stationary 
solutions of f 1 1.11) when the noise is i.i.d. with finite second moments: 

Theorem 6.9. Let m,d,p G N, g G Nq, and let {Zt)tei be an i.i.d. sequence of C^-valued 
random vectors with finite second moment. Let \E'i, . . . , \E'p G C™"^™ and Bq, . . . , Og G 



C™^ . Then the ARMA{p,q) equation f 1 1.11) admits a strictly stationary solution if and 
only if it admits a weakly stationary solution, and in that case, the solution given by (12.171) 
is both a strictly stationary and weakly stationary solution of (11.11) . 



Proof. It follows from Theorem 12.31 that if a weakly stationary solution exists, then one 
choice of such a solution is given by (12.171) . which is clearly also strictly stationary. On the 



other hand, if a strictly stationary solution exists, then by Theorem 12. 2[ one such solution 
is given by (I2.15p . which is clearly weakly stationary. □ 

Finally, we remark that most of the results presented in this paper can be applied 
also to the case when (^t)tgz is an i.i.d. sequence of C'^^''' random matrices and iYt)t£z is 
C'^^'^'-valued. This can be seen by stacking the columns of Zt into a C'^'^'-variate random 
vector Zj, those of Yt into a C™''^'-variate random vector Y/, and considering the matrices 



\ 



-^md' xmd' 



and 61 



■^rnd'xdd' 



The question of existence of a strictly stationary solution of (II. ip with matrix-valued 
Zf and Yf is then equivalent to the existence of a strictly stationary solution of — 

L^k=\ ^k'^t-k — 2^k=Q^k^t-k- 
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